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Abstract 


We  study  the  problem  of  selecting  the  most  reliable  Poisson  population  from  among  k 
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where  n  denotes  the  number  of  historical  data  at  hand  when  the  present  selection  problem 
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1.  Introduction: 


In  the  research  and  development  stage,  an  experimenter  often  confronts  the  problem 
of  selecting  the  most  reliable  design  from  among  several  competing  designs.  Usually,  the 
populations  that  are  compared  are  the  life  length  distributions  of  the  designs.  The  most 
reliable  design  is  defined  as  the  one  with  the  longest  mean  life.  The  problem  of  selecting 
the  most  reliable  design  has  been  studied  in  the  literature.  The  readers  are  referred  to 
Gupta  and  Panchapakesan  (1988)  for  a  comprehensive  survey  of  selection  procedures  in 
reliable  models. 

Consider  k  types  of  competing  designs  7Ti, . . . ,  7r* ,  which  are  put  on  life  tests.  Suppose 
in  case  of  a  failure,  the  failed  design  is  immediately  replaced  by  the  same  type  of  design. 
It  is  assumed  that  the  failure  times  of  type  i  design  are  exponentially  distributed  with  an 
unknown  failure  rate  9{,  and  these  failure  times  are  mutually  independently  distributed. 
Let  0[i]  <  ...  <  jt]  denote  the  ordered  values  of  the  failure  rate  9\ , ...  ,0*.  The  design 
associated  with  the  smallest  failure  rate  9 [j]  is  called  the  most  reliable  design.  Over  a  time 
period,  let  Xi  denote  the  number  of  failures  of  type  i  design.  Then,  Xt  follows  a  Poisson 
distribution  with  occurrence  rate  9{.  With  this  sampling  scheme,  Dixon  and  Bland  (1971) 
derived  a  Bayes  solution  to  the  problem  of  ranking  the  failure  rates  0i,...,0&.  Gupta, 
Leong  and  Wong  (1979)  have  developed  a  subset  selection  procedure  for  selecting  a  subset 
containing  the  most  reliable  design.  Alam  (1971)  and  Alam  and  Thompson  (1973)  have 
also  studied  selection  procedures  for  selecting  the  most  reliable  design  based  on  inverse 
sampling  observations. 

Let  9q  be  a  specified  standard  or  control  level.  Design  7 r;  is  said  to  be  better  than 
the  control  90  and  acceptable  if  9{  <  9q\  otherwise,  7r;  is  said  to  be  bad  and  should  be 
excluded.  In  many  practical  situations,  an  experimenter  makes  a  selection  only  when  the 
most  reliable  design  is  better  that  the  control  9q  .  For  example,  let  9q  be  the  failure  rate 
of  the  currently  used  design.  An  experimenter  may  make  a  selection  from  among  the  k 
competitors  and  replace  the  currently  used  design  by  the  newly  selected  one  provided  the 
newly  selected  design  is  better  than  the  level  9q.  Otherwise,  the  experimenter  may  select 
none  and  continue  using  the  current  design. 

Consider  a  situation  in  which  one  will  be  dealing  with  repeated  independent  selection 


problems.  In  such  instances,  it  is  reasonable  to  formulate  the  component  problem  in  the 
sequence  as  a  Bayes  decision  problem  with  respect  to  an  unknown  prior  distribution  on  the 
parameter  space.  One  then  uses  the  accumulated  historical  data  to  improve  the  decision 
procedures  at  each  stage.  This  is  the  so-called  empirical  Bayes  approach  (see  Robbins 
(1956,  1964)).  Empirical  Bayes  procedures  have  been  derived  for  subset  selection  goals 
by  Deely  (1965).  For  recent  developments  of  empirical  Bayes  selection  procedures  on  the 
research  area  of  ranking  and  selection,  the  readers  are  referred  to  Gupta  and  Liang  (1991), 
Gupta,  Liang  and  Rau  (1994,  1995),  and  the  references  quoted  there. 

In  this  paper,  we  study  the  problem  of  selecting  the  most  reliable  Poisson  population 
provided  it  is  better  than  a  control  using  the  nonparametric  empirical  Bayes  approach. 
The  paper  is  organized  as  follows.  The  selection  problem  is  formulated  in  Section  2. 
For  a  linear  loss,  we  derive  a  Bayes  selection  procedure,  which  is  based  on  the  posterior 
means  of  the  failure  rates  0,-,  i  =  1, . . . ,  k.  The  empirical  Bayes  framework  of  the  selection 
problem  is  described  in  Section  3.  Based  on  the  isotonic  regression  estimators  of  the 
posterior  means  of  the  failure  rates,  an  empirical  Bayes  selection  procedure  is  constructed. 
We  study  the  asymptotic  optimality  of  this  procedure  in  Section  4.  It  is  shown  that 
under  certain  regularity  conditions,  the  proposed  empirical  Bayes  selection  procedure  is 
asymptotically  optimal  and  its  Bayes  risk  converges  to  the  minimum  Bayes  risk  at  a  rate 
of  order  0{exp(-cn ))  for  some  positive  number  c,  where  n  denotes  the  number  of  the 
accumulated  historical  data  at  hand  when  the  present  selection  problem  is  considered. 

2.  Formulation  of  the  Selection  Problem  and  a  Bayes  Selection  Procedure 

Consider  k(>  2)  independent  Poisson  populations  7Ti, . . . ,  tt*,  with  unknown  occur¬ 
rence  rates  0i, . . . ,0*,  respectively.  Let  0[q  < . <  0[q  denote  the  ordered  values  of  the 

parameters  9\ , . . . ,  0*.  It  is  assumed  that  the  exact  pairing  between  the  ordered  and  the 
unordered  parameters  is  unknown.  The  occurrence  rate  0;  may  be  viewed  as  the  failure 
rate  of  type  i  design,  as  described  previously.  Therefore,  in  the  following,  a  population  tt; 
with  0;  =  0[q  is  considered  as  the  most  reliable  population.  Let  0o  be  a  known  pre-specified 
standard  level.  A  population  tt,  with  0;  <  0o  is  said  to  be  better  than  the  control  0o  and 
is  acceptable.  Otherwise,  population  tv ,•  is  said  to  be  bad  and  not  acceptable.  Our  goal  is 
to  derive  empirical  Bayes  procedures  to  select  the  most  reliable  Poisson  population  which 
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should  also  be  better  than  the  control  9$.  If  there  is  no  such  population,  we  select  none 
and  exclude  all  k  competitors  as  bad. 

Let  0,  =  {9  =  (9i, . . .  :6k)\  9%  >  0,  i  =  l,...,k}  be  the  parameter  space  and  let 

k 

A  =  {a  —  (ao,  ai, . . . ,  a^)|  a j  =  0, 1;  i  =  0, 1, . . . ,  k,  and  ^  a*  =  1}  be  the  action  space. 

2  =  0 

For  an  action  a,  when  ai  =  1  for  some  i  =  1, . . . ,  k,  it  means  that  population  7 r,-  is  selected 
as  the  most  reliable  population  and  considered  to  be  better  than  the  control  (9o;  when 
ao  =  1,  it  means  that  all  the  k  populations  are  excluded  as  bad  compared  with  the  control 
#o  and  no  selection  is  made.  We  consider  the  following  linear  loss  :  For  deft  and  aeA. 

k 

L(9,a)  =  yt  aj6j  -min(9^ ],0O)-  (2.1) 

For  each  i  =  1 let  Xt  denote  a  random  observation  arising  from  a  Poisson 
population  7 Vi  with  occurrence  rate  Thus,  conditioning  on  9i,Xi  has  a  probability 
function  fi(x\9i),  where 

fi(x\6i)  -  exp(-6i)9f /x\,  x  =  0,1,2,...  (2.2) 


It  is  assumed  that  9{  is  a  realization  of  a  random  variable  0,  which  has  an  unknown 
prior  distribution  Gi  over  (0,  oo).  The  random  vectors  ( Xi ,  0,),  i  —  1, . . .  ,k,  are  assumed 
to  be  mutually  independent. 

Let  X  be  the  sample  space  generated  by  X  =  (_Yi , . . . ,  Wt).  A  selection  procedure 

6  =  (<5o,<5i, . . .  ,6k )  is  defined  to  be  a  mapping  from  the  sample  space  X  into  the  product 

space  [0,  l]fc+1,  such  that  for  each  xeX:  the  function  S(x)  =  (So(x),  6 i(x), ....  Sk{%))  satisfies 

k 

that  0  <  S{(x )  <  1,  i  =  0, 1, . . . ,  k  and  ^j(?)  =  1.  That  is,  for  each  i  =  1, . . . ,  k,  8j(x)  is 

i=0 

the  probability  of  selecting  population  tt;  as  the  most  reliable  population  and  considering 
7 to  be  better  than  the  control  9o ;  and  <5o(?)  is  the  probability  of  excluding  all  the  k 
populations  as  bad  and  hence  selecting  none. 

Let  C  be  the  class  of  all  selection  procedures.  For  each  8eC,  let  R(G.S)  denote  its 

k 

associated  Bayes  risk,  where  G'($)  =  Gi(9{).  Then  R(G)  =  inf  R(G,8)  is  the  minimum 

i=i  8(C 

Bayes  Risk  among  the  class  C.  A  selection  procedure,  say  8c,  such  that  R(G,  8q)  =  R{G)  is 
called  a  Bayes  selection  procedure.  We  consider  only  these  priors  for  which  9clGi(9)  < 
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oo  for  each  i  —  so  that  for  each  selection  procedure  8yR(G,8)  is  always  finite, 

which  insures  the  selection  problem  to  be  meaningful. 

Based  on  the  preceding  statistical  model,  the  Bayes  risk  associated  with  the  selection 
procedure  8  is: 


k  ~ 

=  \°)dG(d~)  - c 

XeX  i=  0  ^ 


=  E 


XeX  L i=0 


x)^i(xi)  +  8q(x)90 


(2.3) 


/(*)  -  c 


where 


f(x\0)  =  UfM 


i- 1 
k 


/(?) = 


i=l 


fi(xi)  =  J  fi(xi\0i)dGi(B)  =  hi(xi)(xi\)  1 
:the  marginal  probability  function  of  Xi , 


hi(xi) 


exp(—9)9Xi  dGi(O), 


C  =  j  min(6[i],8o)dG(9)  and 

Jn 

iPi(xi)  =  E  [0,1  Ah  =  a:,]  =  hi(xi  +  1  )/hi(xi).  (2.4) 

Note  that  rj>i(xi)  is  the  posterior  mean  of  0,-  given  X i  =  X{. 

From  (2.3),  a  Bayes  selection  procedure  8q  =  (Sgo-,  ■  ■  •  >  8g)c)  can  be  obtained  as  follows: 
For  each  xeX ,  let 


A(x)  =  {z  =  0. 1, . . . ,  k\xbi(xi)  = 


min  ipj(xj)}, 

0<j<k 


(2.5) 


where  0o(-x‘o  )  =  #o-  Define 


ic  =  <g(?)  =  min{i|ie.4(.r)}, 


(2.6) 


D 


and  for  each  i  =  0, . . . ,  k,  define 


c  (  \  /  1,  if  i  =  ?G, 

tGife)  =  ( 


0  otherwise. 


(2.7) 


From  (2.3),  one  can  see  that  8g  is  a  Bayes  selection  procedure.  Also,  it  should  be 
noted  that  any  selection  procedure  8  satisfying  X)  <^(?)  =  1  for  each  xeX  is  always  a 

ieA(X) 

Bayes  selection  procedure. 


The  minimum  Bayes  risk  is  R(G,8g )  where 

k 


R(G,6g)  =  Y, 


XeX 


y i8Gi(x)if>i(xj) 


i= 0 


/(?)  -  c 


=  )/(*)-  C 


(2.8) 


XeX 


3.  Empirical  Bayes  Selection  Procedures 

It  should  be  noted  that  the  Bayes  selection  procedure  8q  depends  on  the  prior  dis¬ 
tribution  G.  Since  G  is  unknown,  it  is  not  possible  to  implement  the  Bayes  procedure  8q 
for  the  selection  problem  at  hand.  In  the  following,  it  is  assumed  that  certain  historical 
data  from  each  of  the  k  populations  are  available.  In  such  a  situation,  the  empirical  Bayes 
approach  is  adopted. 

3.1.  Empirical  Bayes  Framework 

For  each  i  =  1, . . . ,  k,  let  (Xij,  Qij),j  =  1,2, .. .  be  random  vectors  associated  with 
population  7 r,-,  where  Xij  is  observable  while  ©;j  is  unobservable.  Note  that  Qij  stands  for 
the  failure  rate  of  the  design  belonging  to  7T j  at  stage  j .  It  is  assumed  that  Qij  has  a  prior 
distribution  Gi,  for  all  j  =  1,2, ... ,  and  conditioning  on  Qij  —  0ij,Xij  follows  a  Poisson 
distribution  with  occurrence  rate  9ij\  and  (Xij,  Qij),  i  =  1, ...  ,k,j  =  1,2, .. .  are  mutually 
independent.  At  the  present  stage,  say  stage  n  +  1,  let  A’i(n)  =  (Xu, . . .  ,Xin)  denote 
the  accumulated  historical  data  associated  with  tt and  let  X,  =  be  the  present 

random  observation  arising  from  tt* ,  and  9i  =  #,.n+i  be  a  realization  of  0,,„+i,  i  =  1 - ,  k. 

Let  X(n)  =  (A'i(n), . . . ,  A'jt(n))  and  A'  =  (A'x - -  A'*).  At  stage  n  +  1.  we  want  to  select 

the  population  associated  with  provided  that  j  <  0q  using  the  linear  loss  (2.1). 
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By  (2.5)-(2.7),  a  natural  empirical  Bayes  selection  procedure  can  be  derived  as  follows. 
For  each  i  =  1  ,...,&,  based  on  the  accumulated  past  data  Xi{n)  and  the  present  obser¬ 
vation  Xi  =  Xi,  let  i>in{xi)  =  t/>in(xi,Xi(n))  be  an  empirical  Bayes  estimator  of  'ipi(xi). 
Then,  let 


(3.1) 

(3.2) 


Analogous  to  (2.7),  an  empirical  Bayes  selection  procedure  8n  =  (8n o,...,Snk)  can  be 
obtained  as  follows:  For  each  xeX, 


if  i  =  in, 

otherwise. 


(3.3) 


Let  R(G,  £n|X(n))  denote  the  conditional  Bayes  risk  of  the  selection  procedure  8n  given 
X(n)  and  let  R(G ,  8n )  be  the  overall  Bayes  risk  of  8n.  That  is, 


R(G,SnjX(n))  =  J^^in(xin)f(x)  -  C,  (3.4) 

XeX 

and 

R(G,6n)  =  Ex(n]R(G,8n\X(n)),  (3.5) 

where  the  expectation  EX{n)  1S  with  respect  to  the  probability  measure  generated 

by  X(n). 

Note  that  R(G,  £„|A'(n))  -  R(G,8g)  >  0  for  all  X(n)  and  for  all  n,  since  8q  is  a 
Bayes  selection  procedure.  Hence  R(G,8n)  —  R(G,8g)  >  0  for  all  n.  The  nonnegative 
regret  Bayes  risk  R(G,8n)  —  R(G.8g)  can  be  used  as  a  measure  of  performance  of  the 
empirical  Bayes  selection  procedure  8n. 

A  sequence  of  empirical  Bayes  selection  procedures  is  said  to  be  asymptoti¬ 

cally  optimal  relative  to  the  prior  distribution  G  if  R(G,8n)  —  R(G.8g)  — >•  0  as  n  oo. 
Further,  is  said  to  be  asymptotically  optimal  of  order  {ornJ^Lj  relative  to  the 


prior  distribution  G  if  R(G,8n )  —  R(G,8g)  =  0  ((*„)  where  {ctn}^Li  is  a  sequence  of 
positive  numbers  such  that  limn_oo  otn  =  0. 

In  the  following,  we  seek  a  sequence  of  empirical  Bayes  selection  procedures  possessing 
the  asymptotic  optimality. 


3.2  Construction  of  Empirical  Bayes  Selection  Procedure 

To  construct  an  empirical  Bayes  selection  procedure  as  described  in  (3.1)-(3.3),  we 
first  need  to  construct  an  empirical  Bayes  estimator  for  ipi(xi).  Since  ^(aq)  is  increasing 
in  Xi  we  desire  a  monotone  estimator  for  ^q(aq). 


Based  on  Xi(n ),  for  each  x  =  0, 1. . . . ,  define 


fin 0)  =  £  E 

j= i 

hin(x)  =  fin(x)/ a(x). 


(3.6) 


where  a(x)  =  l/{xl).  Note  that  fin(x)  and  h{n(x)  are  unbiased  and  consistent  estimators 
of  fi(x )  and  hi( x),  respectively.  From  (2.4),  /qn(aq  +  l)/hin(xi )  is  a  naive  estimator  of  the 
posterior  mean  ?/q(aq).  However,  this  estimator  may  not  possess  the  monotonicity  property. 
Thus,  we  consider  an  isotonic  regression  version  of  hin(xi  +  1  )/hin(xi). 

Let  Nn  =  min(Xii, . . . ,  Xm)  and  iVin  =  max(Xii , . . . ,  X,„).  For  each  y  =  0,1,..., 
define 

® in(y )  =  E  hin(x  +  1  )a(x  +  1), 

x=0 

Vi (y)  =  E  hi(x  +  l)a(«  +  1), 

i  =  0 

y 

Hin{y)  =  E  hin(x)a(x  +  1), 

Hi(y )  =  E  hi(x)a(x  +  1), 

z—Q 

and  Vin(-l)  =  *i(-l)  =  Hin(- 1)  =  ^i(-l)  =  0. 

Next,  define 

4™(-  a)  «„<],<«„  \  H.Jy)  -  H,JN„  -  1)  J  ’ 

where  b/a  =  co  when  a  =  0;  and  for  each  x  between  (including)  N-n+l  and  Ntn.  recursively, 


(3.7) 


(3.8) 


S 


define 


X  —  1 


^iJx)  =  min  { 
x<y<Ni„ 


^in(y)-  E  ^in(z)hin(z)a(z  +  1) 

_ z~Nn _ 

Hi  n(y)  Hi  n{x  1), 


(3.9) 


Note  that  since  Hin(Nin )  —  Hin(x  —  1)  >  0  for  Nn  <  x  <  Nin,i/j*n(x)  <  oo. 
{'l>in(x)}x=Nil  *s  is°t°nic  regression  of  {hin(x  +  1  )/hin{x)}x=Nil  with  random  weights 
{hin(x)a(x  +  l)}^iV  ,  see  Puri  and  Singh  (1990).  Hence,  ip*n{x)  is  nondecreasing  in  x  for 
x  =  Nn,  •  •  • ,  H in .  By  BBBB  (1972),  for  Nn  <  x  <  Nin , 


X  —  1 


^*in{z)hm{z)a(z  +1)< 


z=N:, 


Z=Ni ! 


hin{z_  +  1) 
hin(z') 


hin^Z^Q^Z  “I-  1) 


x — 1 


=  hin{z  +  1  )a(z  +  1) 
z=Nn 

<^in(x  -  1). 


Therefore,  from  (3.8)  -  (3.10),  we  have,  for  each  x  =  Nn, . . . ,  iVjn, 


Tp*n(x)  >  min 

x<y<Nin 


'Fm(y)  ^  in(x  1)  1 

Hin(y)-Hin(x-l)j 


(3.10) 


(3.11) 


For  x  =  0, 1, . . . ,  Nn  ~  1,  define  tj; *in(x )  =  ^*n{Nn)\  for  x  >  Nin,  define  ij> *n(x )  = 
ip*n(Nin)-  Therefore,  we  see  that  ip*n(x)  is  a  monotone  function  of  the  nonnegative  integers 
x. 

Now,  we  let  S*n  —  (<5*0 ,...,8*k)  be  the  empirical  Bayes  selection  procedure  defined 
through  (3.1)-(3.3)  by  replacing  ^ In(xt- )  by  i>*n{xi).  We  also  denote  its  associated  An(x) 
and  in  by  A*n(x)  and  **,  respectively.  Then,  conditioning  on  X(n),  the  conditional  Bayes 
risk  of  <5*  is: 

R(0,6'n\X(n))  =  £  #, ;(*,-„)/(*)  -  C,  (3.12) 

XeX 

and  its  overall  Bayes  risk  is: 


R(G.6*n)  =  EX[n)R(G,6*n\X(n)). 


(3.13) 
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4.  Asymptotic  Optimality  of  8*n 

In  this  section,  we  evaluate  the  asymptotic  optimality  of  the  empirical  Bayes  selection 
procedure  <5*.  We  assume  the  prior  distribution  G{  being  nondegenerate  so  that  ipi(xi)  is 
strictly  increasing  in  xi.  Let 


5,(1)  =  {xi\if>i(xi)  <  do}, 

Bi(  2)  =  {xi\^i(xi)  =  6>0} 

and  Bi( 3)  =  {xi\ipi(xi)  >  do). 


Define 


f  sup  Bi(l)  if  5^(1)  ^  <f>, 
(  —  1  otherwise; 

(  inf  Bi(3)  if  5,(3)^, 
l  oo  otherwise. 


(4.1) 


By  the  increasing  property  of  r/>i(x),mj  <  M,.  When  5,(3)  ^  <f>,mi  <  Mi  <  oo.  We 
may  have  either  =  rrii  +  1  for  which  5;(2)  =  <p,  or  Mi  =  rrii  +  2  for  which  + 1)  =  Oq 

and  5,(2)  =  {m;  +  1}. 

k 

Let  Ei  denote  the  event  that  iV,i  =  0  and  iV,n  >  M,-  +  2,  i  =  1, . . . ,  k,  and  E  =  f)  5,-; 

i=l 

let  E f  and  Ec  denote  the  complements  of  the  events  Et  and  5,  respectively.  Also,  let 
Ai  =  {xeX\ic(x)  =  i},i  =  0, 1, ... ,  k. 


4.1  Analysis  of  Regret  Bayes  Risk 

From  (2.8)  and  (3.12),  given  X(n):  the  conditional  regret  Bayes  risk  of  6*n  is: 


5(G,r„|A(n))-5(GUG) 

=  ~  ViG(xia)]I(E)f(x) 

XeX 

+  -“'f „(*.•<,)]/(£')/(*) 

Xf.x 


10 


where  I(S)  denotes  the  indicator  function  of  the  event  S.  Now, 


XeX 

A  k 

=  EEEjk  ( x )  =  *,*g(5)  =  i  and  f7}[^i(z<)  -  ^j(xj )]f(x) 

XeX  i= 0  j=0 
k 

=  EE'<-  *(5)  =  )  =  0,E}[V>i(xi)  -  0o]/(?) 

£eA0  2=1 

+  EE  /{•;(?)  =0,<c(s)=j,B}[«o-^(*j)]/(x) 

j=l  XeAj 
A:  A 

+EEE'«  (x)  =  i,ic(x )  =i,-E}[V’i(®i)  -$}{*] )]/(?)• 

i=i  1=1  XfAj 

On  Ao,  for  ieA(x),ipi(xi)  =  #o-  So, 

I{i£(z)  =  mg(? )  =  0,jE}[V’j(a:i)  -  0O] 

=I{i*n(x)  =  Mg(?)  =  0,i^A(z),i7}[^i(zi)  -  90]. 


(4.3) 


(4.4) 


For  each  j  =  1, . . . ,  k,  on  Aj,  for  ieA(x),  ipi(xi)  —  xl>j(xj).  So, 

I{i*n(x)  =  *\*g(?)  =  i,-E}[^*(*«)  - 

=!{?*(?)  =  Mg(?)  =  JS7}[^»i(xi)  -  ^j(zj)]. 

Combining  (4.2)-(4.6),  the  regret  Bayes  risk  of  6*  can  be  written  as: 


(4.5) 


R(G,6*n)-R(G,6G) 

k 

=  EE  =  Mg(?)  =  0,  i#A(x),  E}[tpi(xi)  -  do }f(x) 

XeA0  i— 1 
k 

+  EE  =  °>  *<?(?)  =  j,O£.4(g),£}[0o  )]/(?) 

j= 1  ?fA,-  ~  (4.6) 

A-  A 

+  EEE  %(n)I{C(?)  =  "  ^(*i)]/(?) 

i=i  i=i 

.Tc.Y 

=JB  +  JJn  +  //J„  +  IVn. 
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4.2  Propositions 


Proposition  4.1  For  xeAo  and  i^A(x), 

EX(n )J{C(?)  =  Mg(?)  =  0,i£A(x)  and  E} 

<  d  exp{  — 2n  [ &,•  (M,- ,  90 )  min(  1 ,  9q  1  )/4]2  } , 

where  bi(Mi,0 o)  =  +  1)  -  0o/i;(M;)]a(M;  +  1)  and  d  is  a  constant  independent  of 

the  distribution  of  X(n). 

Proof:  For  xeAo  and  i  £  A(x),  we  have  x,-  >  Mi  and  tpi(xi)  >  <?o-  By  definitions  of  i*n,ic 
and  the  monotonicity  of  the  function  t/>*n(x),  we  obtain  the  following: 

EX(n)I{i*n(x )  =  *,*g(x)  =  0,  i  $  A(x)  and  E) 

<P{^*n(xi)  <  0O  and  E] 

<P{tfn(Mi )  <  0O  and  £} 

<dexp{— 2n[6i(Mi,<90)min(l,  ^X)/4]2}, 

where  the  last  inequality  is  obtained  from  Corollary  5.1.  d 

Proposition  4.2  For  each  j  =  1, . . . ,  k  and  for  x  €  Aj , 

TTlj 

EX{ »/{*»(?)  =  °>  *<?(*)  =  i  and  ^  X]exp{-2nc5(z,6lo)}, 

2  =  0 

where  Cj(z,0o)  =  [M*  +  1)  -  9ohj(z)]  /(y^y  +  $y)- 

Proof:  For  x  €  Aj,  Xj  <  rrij  and  ip(xj)  <  9o .  Thus,  by  the  monotonicity  of  tb*jn{x)  and 
by  Corollary  5.2,  we  can  obtain 

EX{n)I({l*n(x)  =  0 ,*g(5)  =  j  and  E) 

<  P{ib*n(xj )  >  0o  and  £} 

<  P{4'jn(m,j)  >  9q  and  E) 

m  j 

<  y>  exp{-2ncy(x,g0)}.  □ 

;=0 
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For  each  j  =  1, . . . ,  k,  each  xeAj  and  i^A(x),  ipj(xj)  =  <  mm(9o,^i(xi))- 

There  are  two  cases  regarding  the  value  of  Xi  :  either  xt  >  Mi  for  which  tpi(xi)  >  #o  or 
Xi  <  Mi  —  1.  Thus, 

EX{n)I{in{^)  =  *,*g(*)  =j,i£A{x)  and  E) 

=EX(n)I{^n{x)  =  i,iG{x)  =  j,i£A(x),Xi  >  Mi  and  E) 

+  Ex^n)I{i*n(x)  =  i,iG(x)  =  j,i£A(x),Xi  <  Mi-1  and  E}. 


Proposition  4.3 

(a)  =  i,iG(x)  =  j,i^A(x),Xi  >  Mi  and  E) 

<  d  exp{  —  2n[6j(M;, $o) min(l, 0^"1)/4]  }. 

(b)  =  *\*g(*)  =  j,i&A(x),Xi  <M{-  1  and  £} 

<  dexp{  — 2n[bi(xi,  s(xi,  Xj))  min(l,  l/s{xi,  Xj))/A\2}. 

xi 

+  Yj  exp{-2 nc){z,s(xi,Xj))}, 

z—  0 

where  s(xi,xj )  =  [^(x;)  +  f/>j(£;)]/2. 


Proof: 

(a)  ^X(»)^*»(?)  =  *>*<?(*)  =  j,i£A(x),Xi  >  Mi  and  E} 

<  P{rin(xi)  <  9o,Xi  >  Mi  and  E) 

<  P{xj)*n{Mi)  <  90  and  E} 

<  dexp{  — 2n[bi(Mi,  Qo)  min(l,  9q1)/A\  }, 
by  Corollary  5.1. 

(b)  Note  that  x l’j(xj)  <  s(xi,xj)  =  [xpi(xi)  +  i/>j(xj)]/ 2  <  ipi(xi).  By  Corollaries  5.1  and 
5.2, 

Ex -(n)/{<*(?)  =  i,iG(x)  =j,i#A(x),Xi  <  Mt  -  1  and  E) 

<P{4U.Xi)  ~  r]n(xj)  <  0  and  E) 

=P{WnM  -  4’i(xt)\  ~  U'jn(xj)  ~  Vj(xj)]  <  +  ^j(xj)  and  E) 
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^P{1>in(xi)  ~  $ i(Xi )  <  l~^i(xi)  +  <Pj(xj)\/2  and  E) 

+  pU>jn(xj)  -  Vh'Oj)  >  [*l>i(xi)  “  ^j(xj)]f 2  and  E} 

=p{0*ra(x2)  <  s(xi,Xj )  and  £} 

+  P{V>*n(zj)  >  s(xi,Xj )  and  E1} 

<dexp{—2n[bi(xi,  s(xi,xj ))  min(l,  l/$(xj,  ®j))/4]2} 

xj 

+  ^  exp{— 2rec;(z,  s(s,,  Xj))}. 

2=0 

Proposition  4.4 

XeX 

k 

<C\  [exp{  — n  £n[  1  — /i(0)]-1}  +  exp{  — n  ^n[JFi(Afj  +  1 )] — 1 }] , 
2=1 

k 

where  C\  =  do  +  J  9dGi(9). 

2=1 


Proof: 


Therefore, 


where 


0  <  y  bl’iiixi-)  ~  'l>iG(xia)]f(x)I(EC) 

XeX 

k 

XeX  2=1 


=  {9o  +  E  /  M?f(W(£c) 

;=i  ^ 


=  C\I{EC). 


EX(n){[J2[M^n  )  "  ^C(z!G)]/(5M£C)}  <  CiP^6}, 

XtX 


k 

p(Ec )  <  E  ) 

2=1 

k 

=  y  [P{A’ii  >  0}  +  P{iVm  <  M  +  1}] 

2=1 

=  Eli1  -  /.(°r  +  [aw  +  di”]. 

2=1 


□ 
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Hence  the  result  follows. 


□ 


4.3  Rate  of  Convergence 

The  main  result  of  this  paper  is  regarding  the  rate  of  convergence  of  the  regret  Bayes 
risk  of  the  empirical  Bayes  selection  procedure  S*n.  This  result  is  stated  as  a  theorem  as 
follows. 


Theorem  4.1  Let  S*n  be  the  empirical  Bayes  selection  procedure  constructed  in  Section 
3.  Suppose  that 

(a)  J0°°  ddGi(O)  <  oo  for  each  i  -  1  and 

(b)  Mi  <  oo  for  each  i  =  1, . . . ,  k. 

Then,  R(G,S*)  —  R(G,Sq)  =  0(exp{— 7«})  for  some  constant  7  >  0. 


Proof:  To  prove  this  theorem,  it  suffices  to  investigate  the  asymptotic  behaviors  of  the 
four  terms  IIIn  and  IVn  given  in  (4.6). 

2 

(I)  Let  7i,-  =  2[6,(Mi,^0)min(l,(9^1)/4]  and  71  =  min  71*.  Note  that  71,  >  0  for  each 

l<i<k 

i  =  1, . . . ,  k  and  therefore  71  >  0.  By  Proposition  4.1, 


In  <  -n'Yi  i}ipi(xi)f(x) 

XeAo  i=  1 

k 

<  dexp{-n7i}  ^2^ipi(xi)f(x) 
XtX  i— 1 
poo 

=  d exp {-7171} [y*  /  QdGi(O)]. 

i= 1  Jo 


(II)  Let  72 j  =  2  min  c2Az,9o)  and  72  =  min 

0 <  ~<  m;-  J 


'/2i  - 


Then  72  j  >  0  for  each  j  =  1. - k. 
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and  therefore,  72  >  0.  By  Proposition  4.2, 


k  mj 

j- 1  Xe.4;  z=0 

k 

<  dp  exp {— 7^72} [max(m1, . . .  ,mk)  +  1]  X  X  /(?) 

j=l  X«A;- 

<  #o  exp{-n72}[max(mi, . .  -  ,mk)  +  1] 

since  £  X)  /(*)  <  1- 
j= 1  Xe-4; 

(III)  For  each  i  7^  j,  let  A,-(i)  =  {xeAj|xi  <  Mt  -  1},  A^(»)  =  {xeAj|xi  >  MJ.  Thus, 

U/n 

A:  fc 

=  ££  £  Ex{n)I{i*n(x)  =  i,  iG(x)  =  j,i  $  A(x),  xt  <  Mi  -  1,  E}[^i(xi)  -  *l>j(xj)]f(x) 

j=l  2=1  XeAj(i) 

A;  A: 

+EE  £  •^(n^nfe)  =  *>*g(?)  =i»*  £  A(x),Xi  >  Mi,£}[V’i(xi)  -0i(xj)]/(x) 

J=1  i=l  XeAj(i) 

=  IHnl  +  III»2. 


For  xeAj(i),Xj  <  rrij,Xi  <  Mi  —  1.  Let 


73iji(?)  =  2[6i(xi,s(xi,Xj))min(l,l/s(xi,Xj))/4]2. 

Note  that  73iji(x)  >  0.  Also,  73iji(x)  depends  on  x  only  through  x,-  and  Xj,  for  which 
0  <Xi  <  Mi  —  1,  and  0  <  x<  <  ra,-.  Therefore,  73 „i  =  min  73iyi(x)  >  0. 

X€Aj(i) 

Let  73 ij2(x,z)  =  2cj(z,s(xi,Xj)),0  <  2  <  xj.  Note  that  73ij2(x,z)  >  0  for  each 
0  <  z  <  xj.  Therefore, 

73 ij2(x)=  min  73ij2(x,s)  >  0,73,72  =  min  73^2 (z)  >  0, 

0  X  e  A  j  ( t ) 

73  ij  -  min(73iji,73ij2)  >  0, 73.  =  min  73 ,y  >  0  and  73  =  ^in^i  >  0. 

7*7 
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By  Proposition  4.3(b), 


k  k 


Him  <  EE  E  [dexp{-ray3}  +  (xj  +  1)  exp{-nj5}]^i(xi)f(x) 

j=l  2=1  XtAj  (2) 

k  k 

<  [d  +  max(mi, . . . ,  m^)  +  1]  exp{— 7173  )EE  E 

j=  1  2=1  XeAj(i) 

&  l*oo 

<  [d  +  max(mi, . . .  ,  mfc)  +  1]  exp{— n73}fc[^J  /  0dGj(0)]. 

i=i 

By  Proposition  4.3  (a)  and  the  definition  of  71  i , 


k  k 


I][In2  <  ^2  5Z  S  dexp{-n7ii}^i(x,)/(x) 
3=1  2=1  XeA^(i) 

k  k 

<  <iexp{  — 

3  =  1  2=1  XeiJ(i') 

^  /*  00 

<  d exp { — nji } k j  0dGi(9)\. 


2=1 


(IV)  Let  74i  =  min(fn[l  -  fi(0)]  1,£n[Fi(Mi  4-1)]  *)  and  74  =  min  74 

l<i<k 

Then  y4^  >  0  for  each  i  =  1, . . . ,  k  and  therefore  74  >  0.  By  Proposition  4.4, 

IVn  <  2kCi  exp{-n74}, 

where  Cx  =  90  +  Y  /0°°  9dG{{9). 
i= 1 

Now,  7  =  min(7i,72,73,74)  >  0.  From  the  preceding  analysis,  we  have:  In  — 
0(exp(— yn)),  IIn  —  0(exp(— yn)), ///„  =  0(exp(— yn))  and  IVn  =  0(exp(— yn)).  There¬ 
fore,  from  (4.6),  we  conclude  that  R(G,S *)  —  R(G,Sc  =  0(exp{— yn}). 


5.  Preliminary  Results 

In  this  section,  we  introduce  certain  preliminary  results  for  presenting  a  concise  proofs 
for  the  Propositions  of  Section  4. 
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Define  A<pin(y)  =  ^(y)-^),  AHin(y)  =  Hin(y)-Hi(y).  Also,  let  Fi(y)  denote  the 
marginal  distribution  function  of  the  random  variable  AT,-,  and  let  Fin(y )  be  the  empirical 
distribution  based  on  Xi(n). 

Lemma  5.1  For  c  >  0  and  0  <  x  <  N{ni 

(a)  [ \j  {A*in(y)  -  A\a{n(x  -  1)  <  -c}]  C  {sup  \Fin(y)  -  Fi(y)\  >  §}. 

y—x  y  >0 

(b)  [  U  {Aff.  jy)  -  AHin{x  -  1)  >  c}]  C  {sup| Fin(y)  -  Fi(y) \  >  §}. 

y—x  y> 0 

Proof:  (a)  From  (3.7),  for  y  >  x  >  0, 

y 

A *in(y)  -  A*in(x  -  1)  =  +  1)  -  hi(z  +  1  )\a(z  +  1) 

Z—X 

=  [Fin(y  +  1)  -  Ft{y  +  1)]  -  [Fin(x)  -  Fi(x)}. 

Therefore, 

Nin 

y—X 

Nin 

C  |j  {Fin(y  +  1)  -  Fi(y  +  1)  <  or  Fin(x)  -  Fi(x)  >  |} 

y—x 

C{sup  \Fin(y)  —  Fi(y)\  >  ^ } . 
y>  o 

(b)  Note  that  for  y  >  x  >  0 

&Hin(y)  -  &Hin(x)  = 

where  a^~,+,1)  =  — which  is  decreasing  in  x  for  x  =  0. 1, . . . ,  and  bounded  above  by 
1.  Then  by  Lemma  3.1  of  Gupta  and  Liang  (1991).  and  following  a  proof  analogous 


IS 


to  that  of  part  (a)  of  this  lemma,  we  obtain 
Nin 

U  -  A Hin(x  -  1)  >  c] 

y—x 
y 

=  {^2[hin(z)  -  hi(z)]a(z)/(z  +  1)  >  c  for  some  x  <  y  <  Nin } 

Z=X 

y 

c{i£fc»  ( z )  —  hi(z)\a(z) / (z  +  1)|  >  c  for  some  y  >  x} 

Z  —  X 

oo 

C{|  y ^[hin(z)  -  hi(z)]a(z) \  >  c  for  some  y  >  x} 

Z—X 

C{sup  \Fin(y)  —  Fi(y)\  >  ^}. 

y>0  ^ 

Hence  the  proof  is  completed.  □ 

Define  6,(x,  c)  =  [hi(x  +  1)  —  chi(x)]a(x  +  1),  x  =  0,1,...,  and  i  =  1, . . . ,  k. 

Lemma  5.2  For  y  >  x  >  0  and  0  <  c  <  ipi(x), 

[-'&i(y)  +  $i(x  -  1)]  +  c[Hi(y)  -  Hj( x  -  1)]  <  -6<(*,c)  <  0. 

Proof:  By  the  increasing  property  of  ipi(x),  ipi(y)  >  ijji(x)  >  c  for  y  >  x. 

From  (3.7),  for  y  >  x, 

h*i(v)  +  *■(*  "  l)]  +  c[#(y)  -  -  1)1 

=  ~J2  h^—h ~  c^z  +  ^ 

<  -  c]g(x  +  1) 

=  - bi(x,c ) 

<  0 


since  "-jpjry--  =  ipi(z)  >  ipi(x)  >  c  for  all  2  >  x  and  h{(z)  >  0  for  all  2  =  0, 1, ... .  Hence  the 
proof  is  completed.  □ 


Lemma  5.3  For  each  x  =  0, 1, . . . ,  m,-  +  2,  and  c  such  that  0  <  c  <  ipi(x), 

{+*,(.'£)  <  c  and  E}  C  {sup  | Fin(y)  -  Fi(y)\  >  6;(x,c)min(l,c_1)/4}. 

y>o 
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Proof:  On  E,  mi  +  2  <  Nin  and  Nn  =  0.  Thus,  from  (3.11),  for  each  x  =  0, 1, . . . ,  m,  +  2 
and  0  <  c  <  by  Lemma  5.2, 

{</> *n(x )  <  c  and  E} 

_f  •  ^m(y)  ~  ~  1)  ^  -I 

{*<i<Nin  Hin(y )  -  Hin(x  -  1)  ~  ' 


iV.n 

c  U  {[*i»(y)  -  *i„(*  -  1)]  -  c[#„(y)  -  iJ,„(x  -  1)]  <  0}] 


2/=z 


[A*f»(y)  -  &*tn(x  - !)]  -  c[A^;n(y)  -  &Hin(x  - 1)] 

<  (-^i(y)  +  ^(x  -  1)]  +  c[Hi(y )  -  LL(x  -  1)] 


Nin 

c[(j  {[A*in(y)  -  A *<n(x  -  1)]  -  c[Aff,.„(y)  -  -  1)]  <  -&i(x,c)}] 

y=X 
Nin 


C[|J({[A^;n(y)  -  A*{n(x  -  1)  <  |J{Ag,.n(y)  -  A H.n(x  -  1)  >  ;})] 


6i(x,c). 


C{sup|Fin(y)  -  Fi(y) \  >  &i(x,c)min(l,c  x)/4}, 

y>0 


where  the  last  inclusion  relation  is  obtained  due  to  Lemma  5.1. 


This  completes  the  proof.  □ 

By  Lemma  5.3  and  the  probability  inequality  for  Kolmogorov- Smirnov  distance  estab¬ 
lished  by  Dvoretzky,  Kiefer  and  Wolfowitz  (1956),  we  establish  an  exponential-type  upper 
bound  for  the  term  P{tp*n(x)  <  c  and  E}. 


Corollary  5.1  Under  the  statement  of  Lemma  5.3, 

P{ip*n(x)  <  c  and  E}  <  dexp{— 2ra[6,(x,c)min(l, c_1)/4]2}, 
where  d  is  a  constant  independent  of  the  distribution  function  Fz. 

Lemma  5.4  For  each  x  =  0, 1, . . . ,  +  2,  and  a  positive  value  c  >  b’;(x), 

{ip*n  >  c  and  E }  C  {hin(z  +  1)  —  chin(z )  >  0  for  some  0  <  2  <  x}. 


Proof:  On  E,  Nn  —  0  and  iVtn  >  mj  +  2  and  {t'*n(x)}^ln0  is  the  isotonic  regression  version 
of  {hin(x  +  l)/hin(x)}"in0.  Hence,  t/>*n(x)  >  c  implies  that  h.in(z  +  1  )/hin(z)  >  c  for  some 
0  <  z  <  x.  Therefore,  the  result  follows  immediately.  □ 
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Lemma  5.5  For  a  positive  value  c  such  that  hi(z  +  1)  —  chi(z)  <  0, 

P{hin(z  +  1)  -  chin(z )  >  0}  <  exp{-2nef(z,c)}, 
where  a(z,  c)  =  [hi(z  +  1)  -  chi(z)]/[-^i )  +  ^)3- 

Proof:  Note  that  hin(z  +  1)  -  chin(z)  —  £  J2  Wij(z ),  where  W{j(z)  —  - 

j= i 

ffizF*" >  J  —  1)  are  iid ,  bounded  random  variables  such  that  —  <  1^(2)  < 

— Yy  and  -®X(n)[1^rb'('2:)]  =  hi(z  +  1)  —  chi(z).  Therefore,  by  Hoeffding’s  inequality,  we 
have 

P{hin(z  +  1)  -  chin(z)  >  0} 

1  n 

=P{~  XI  Wij^z)  ~  [h*(z  +  1)  _  chi(z)\  >  ~[hi(z  +  1)  -  chi(z))} 

U  i= i. 

<  exp{— 2nc^(z,  c)}.  □ 

The  following  corollary  is  a  direct  consequence  of  Lemmas  5.4  and  5.5. 

Corollary  5.2  Under  the  statement  of  Lemma  5.4, 

X 

P{v*n(x)  ^  c  and  E }  <  J]exp{-2ncf(z,c)}. 

i=0 
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